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AMENDMENT ACCOMPANYING APPLICATION 

Honorable Commissioner of 
Patents and Trademarks 
Washington, D.C. 2023 1 

Dear Sir: 

The present application is the national filing of International Application No. 
PCT/GB98/01916. Appended hereto is a copy of the International Preliminary Examination 
Report for that application, having appended thereto the claims as they appear in the international 
application. Before calculation of the national filing fee in the United States, it is requested that 
the application be amended as follows: 
In the Claims 

Claim 4, line 1, delete "any of claims 1 to 3" and substitute - - claim 1 - - 

Claims 5, 6 and 7, line 1 , delete "any of the preceding claims" and substitute - - claim 1 - 



Claim 9, line 1, delete "or claim 8" 

Claim 1 1, line 1, delete "any of the preceding claims" and substitute - - claim 1 - 
Claim 15, line 1, delete "or claim 14" 



2 



Claim 16, lines 1 and 2, delete "any, one of claims 13 to 1 5" and substitute - - claim 13 - - 
Claim 17, lines 1 and 2, delete "any one of claims 13 to 16" and substitute - - claim 13 - - 



The above amendments are being made in order to eliminate multiple dependency and 
improper multiple dependency from the application before calculation of the application filing fee. 
Should any multiple dependency remain, that is unintended, and the Patent and Trademark Office 
is requested to cancel any remaining multiple dependent claims without prejudice before 
calculation of the application filing fee. 

Examination of the application on its merits is awaited. 
January 7, 2000 Respectfully submitted. 
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IMAGE ANALYSIS SYSTEMS AND D 571 CSS 
FOR USE THSRSWITH 



FIELD OF THE I WENT I ON 

This invenCicn relates to image analysis i 
information, such as reagent codes, especial 
of devices used in antibiotic susceptibility 
organisms . 

BACKGROUND TO THE INVENTION 

For many 'years, antibiotic susceptibility testing ("AST") has 
been used as a means for identifying parcicular groups or 
species of micro-organisms, or for identifying an antibiotic 
type or dose level most appropriate for dealing with a clinical 
infection. An internationally recognised standard procedure 
has been evolved using carrier devices, usually in the form of 
membrane disks, impregnated with known amounts of specific 
antibiotics. These disks are used in conjunction with Petri- 
dish plates containing a layer of growth medium, such as agar 
gel, to which a material containing micro-organisms is applied. 
An arrangem^ent of individual disks containing different amounts 
or types of antibiotics are placed on the gel surface at spaced 
intervals. Usually 6 or 8 diaJcs are placed in a circular array 
on -fe^e Petri-dish. The disks are normally cf paper or other 
porous sheet material. The antibiotic diffuses out of each 
disk into the surroixnding growth medium and establishes a 
radial concentration gradient around the disk. The relative 
susceptibility of the micro-organisms to the antibiotic is 
revealed by the diameter of the zone surrounding the disk 
within which growth cf the micro-organism.s is inhibited. The 
detailed morphology of the zone can be indicative of the 
species or genus of micro-organism present. Visual 
interpretation of the results therefore requires considerable 
experience and 



.n the reading of 
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skill, especially if adjacent zones of inhibition are large 
enough to overlap . 



AST is applied on a very large scale worldwide, especially 
5 in clinical laboratories . In order to speed up and 

simplify the reading of such tests, various proposals have 
been made including the evaluation of the results using 
image analysis equipment, for example comprising a video 
camera linked to electronic information processing means 
10 such as a microprocessor. Reading systems of this type are 

available commercially. However, even with the equipment 
available today, there is still need for considerable 
skilled human input . 

15 Because each culture plate will normally carry quite a 

number of disks each of which may be impregnated with a 
different amount of antibiotic, or indeed possibly an 
antibiotic different from that on other disks on the plate, 
it is absolutely essential that the identity of each disk 

20 is precisely determined. In accordance with a WHO- 

recommended standard, each disk bears a printed code which 
identifies the specific antibiotic on the disk and also its 
concentration. This code comprises a combination of 
letters and numerals which can be read easily by the human 

25 eye. The presently available "automated" imaging systems 

require that the operator reads the code on each disk by 
eye, and enters this information manually into the 
electronic processor, for example by means of a keyboard. 
Although optical character readers exist which can convert 

30 printed letters and numerals into electronic information, 

the printed characters must be aligned properly with the 
reading equipment if the optical character reader is to 
recognise the individual characters correctly. The disks 
used in AST are usually applied to the plates by means of 

3 5 mechanical applicators which release individual disks from 

an array of magazines, each holding a stack of identical 
disks . No attempt is made to control the orientation of 
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the codes on the disks that drop from the applicator onto 
the plate surface. The disks are normally found on the 
plate with their printed codes orientated in a thoroughly 
random manner. 

GENERAL DESCRIPTION OF THE INVENTION 

By the invention we provide an improved image analysis 
system for use in AST and comparable testing methods in 
which each disk carries, in addition to the reagent code, 
a means by which the image analyser can determine the 
orientation of the code relative to an optimal reading 
direction for that code. In effect, the code or its image 
is brought into canonical alignment relative to the means 
provided for reading the code. For example, each disk can 
be printed with a simple continuous line, arranged for 
example parallel to the optimal reading direction of the 
code. The simple line can be recognised by the image 
analyser, and the electronic processor can be programmed to 
adjust the actual reading direction to be in accordance 
with a pre -determined direction relative to the observed 
line, e.g. parallel to the observed line and hence in the 
optimal direction for accurate character reading of the 
code. Individual disks in the array can be read in 
succession, with the reading direction being adjusted as 
appropriate. The fact that the codes on the individual 
disks may be arx'anged in a random manner both in relation 
to the initial reading direction and in relation to each 
other is rendered immaterial by the ability of the reading 
equipment to match the reading direction to the appropriate 
direction for each individual disk. 

In one embodiment, the invention provides a readable 
information-bearing device, for example a testing device 
comprising a reagent -bearing carrier, e.g. an AST disk, 
which device incorporates __orientation means by which an 
image analyser can determine the optimal reading direction 
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of the readable information on the device. 

Preferably, the orientation means comprises an arrangement 
of information presented on the device surface, in addition 
to one or more characters indicative of any reagent present 
in the disk ('reagent code') . For example, the orientation 
means can comprise linearly- arranged information. 
Conveniently, this linearly- arranged information is 
parallel to the optimal reading direction of the reagent 
code. An example of a very suitable form of linearly- 
arranged information is a printed line. Discontinuous, or 
multiple, lines can be used if desired. Alternatively, the 
orientation means can comprise one or more recognisable 
features, for example two diametrically-opposed 
indentations in the circumference of the disk, defining 
between them an axis from which the reading means can 
determine the correct reading orientation for the disk 
code. In order that the reading means can correctly 
distinguish whether the code is upside-down, even though 
correctly aligned, the orientation means can for example be 
off -set relative to the reading direction in a way that 
enables the reading means to determine which way up the 
code should be. For example, the orientation means can be 
a printed line below the code, ie. an "underline". Thus, 
desirably, the line or other orientation means is off-set 
from the centre of the disk so that the disk cannot be 
inadvertantly "read" upside-down. 

An important embodiment of the invention is an AST disk 
bearing a printed multi- character code and incorporating 
orientation means whereby code-reading means can determine 
the orientation of the multi- character code and can adjust 
as required the orientation of either the printed code or 
of an image thereof to bring the perceived orientation into 
alignment with that necessary for proper reading of the 
multi- character code. Preferably, said reading means 
comprises camera means and image analysis means. 
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Preferably said orientation means comrises an underline 
printed beneath the multi-character code. 

Another embodiment of the invention is an image analysis 
5 system for interpreting AST plates, comprising-. 

support means for supporting an AST plate; 

camera means for imaging a plate supported by said 
10 supporting means; and 

electronic information processing means, preferably a 
neural net, linked to said camera means, programmed or 
trained to : 

15 

locate an AST disk on said plate; 

identify an orientation means on the located disk, and 
rotate the perceived image of the located disk as 

2 0 required so that the perceived image of a multi- 

character code printed on the disk is brought into 
alignment with a proper reading direction for the 
code ; and 

25 read the code. 

Desirably, the image analysis system additionally 
determines a visible characteristic, such as the diameter, 
of the zone of inhibition (if any) surrounding the disk, 

3 0 and associates this characteristic with the code. This 

determination can be performed prior to, during, or after 
code reading . 

Preferably, the electronic information processing means 
35 includes or is linked to an 'expert system' comprising a 

database of AST characteristics of known micro-organisms. 
This can include a number of "expert rules" for 
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interpreting the perceived image of the zone of inhibition. 

The invention therefore provides an AST reading system or 
the like having the capability automatically to read the 
5 reagent code, relate this code to a specific 

reagent/concentration, and link this information to a set 
of "expert rules" and a database. No commercially- 
available reading system has this capability. 

10 It may not be necessary for the reading system to read the 

code on every disk on the plate. Because most test 
procedures are very repetitive and standardised, the system 
can be pre-programmed to expect certain combinations of 
disk codes on a plate, for example a routine sequence of 

15 disks arranged around the plate circumference. When the 

system has identified the codes on some eg. on two, of the 
disks, this may be sufficient for the system to match the 
arrangement with an expected disk array and therefore 
deduce from its memory the reagent identity on the 

20 remaining "unread" disks on the plate. If necessary, the 

operator can input this information into the reading system 
when the disks are applied to a batch of plates," or when a 
disk dispenser is loaded with disks ready for use. 

25 An example of important zone morphology is beta-lactamase 

activity, which manifests itself visibly by the growth of 
spots or mini-colonies of micro-organisms within the zone. 

It is convenient if the analysis system includes display 
3 0 means for displaying the disk image. 

Adjustment of the reading direction can be achieved readily 
by, for example, presenting the plate on a rotatable 
support or holder to the reading means, so that the axis of 
35 rotation of the holder is orthoganol to the reading plane. 

After identifying the orientation means, the reading means 
can cause the support or holder to be rotated about this 
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axis, as necessary, until the orientation means is brought 
into a pre -determined alignment, and the disk code can then 
be read. Alternatively, the plate can remain in a constant 
location and the camera or other reading means can be 
rotated as necessary to bring the code image into correct 
reading alignment. As a further alternative, both the 
plate and the reading means can remain constantly located, 
and the electronic information processor can be programmed 
or "trained" to rotate the image seen by the reading means 
until the proper alignment is achieved. It may also be 
appropriate to rotate either the camera or the plate to 
bring separate members of a plurality of disks on the plate 
into view for reading in succession. Alternative 
geometries can be used to cope with other information 
arrangements, such as a linear array of reagent -bearing 
carrier devices, although such arrangements are not 
currently used as standard practice within the 
microbiology-related industry. 

The invention also provides an image analyser for use in 
determining the result of susceptibility testing of micro- 
organisms on a culture medium, comprising: 



a) camera means for viewing the culture medium; 

25 

b) electronic information processing means, linked to 
said camera means, programmed or trained to interpret anv 
region of visibly altered micro-organism growth in the 
vicinity of a susceptibility testing disk present on the 

30 culture medium, wherein said processing means is also 

programmed or trained to read a character code on the disk 
indicative of the susceptibility reagent in the disk and to 
interpret orientation means incorporated in or on the disk 
by which the optimal reading direction of the character 

3 5 code can be recognised, and to adjust as necessary the 

actual reading direction to bring this into line with the 
actual orientation of the character code on the disk. 
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Character code reading is based on pattern recognition. 
Sophisticated electronic processing equipment, which may 
utilise neural nets, are now available which can be 
programmed or trained to cope with the demands imposed by 
5 the adjustable reading system of the invention. 

If necessary, the character code on the disk can be printed 
using a font chosen to match the reading capability of the 
reading means. However, as optical character recognition 
10 (OCR) technology advances, the need for a specific font to 

be used may decrease . 

It will be appreciated that although the present-day 
industry standard involves the use of circular disks as 
jyl5 carriers for the antibiotics, this carrier shape is merely 

incidental as far as the invention is concerned. Other 
carrier shapes can be chosen if desired. 

Expressed more broadly, and useful in a far wider context 
20 than the reading of AST disk codes, the invention provides 

an optical character reader having the capability of 
adjusting its reading direction to read correctly a 
combination of characters irrespective of the orientation 
of the characters when presented to the reader. This will 
25 greatly facilitate the OCR reading of documentary 

information, by avoiding the need for each document to be 
presented to the reader in a pre -determined orientation. 
As described above, each document can contain an 
orientating signal, such as a printed line or lines, from 
3 0 which the OCR reader can determine the optimal reading 

direction for the document text. 

SPECIFIC DSSCRIPTIOIT OF A PREFERRED EMBODI21ENT 

35 By way of example only, a system for determining the 

results of antibiotic susceptibility testing is illustrated 
in the accompanying drawings and is described, in detail 
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below . 

1 .' Brief DescriTJtion of the Drawincrs 

5 Figure 1 illustrates the general layout of an AST plate 

reading system in accordance with the invention. 

Figures 2a to 2c show the sequence involved in optically 
reading a character in the code on an AST disk. 

10 

Figure 2a shows a typical image of a character as seen by 
the camera. 

Figure 2b shows a segmented bit -map of the character. 

15 

Figure 2c shows a binarised vector representing the 
character. The character is recognised as an "A". 

Figures 3a to 3c show the stages in correctly orientating 
20 the character code by means of an underline. 

Figure 3a shows a "grey" image of the disk. 

Figure 3b shows a binary image of the disk code. 

25 

Figure 3c shows the rotated image of the code. 

Figures 4a to 4c show the sequence involved in locating the 
position of disks on an AST plate. 

30 

Figure 4a shows a "grey" image of the AST plate. 
Figure 4b shows the detected disks binary image. 
35 Figure 4c shows the inhibition zones binary image. 



Figures 5a and 5b show a typical result of determining che 
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inhibition zone radii in accordance with the invention. 

Figure Sa shows a typical image of a disk with large 
overlapping zones of inhibition. 



Figure 5b shows the computer perceived circumferences of 
the zones after radii have been fitted to the zone images. 

Figures 6a/b and 7a/b show the results of other experiments 
10 comparable to those shown in Figures 5a/b. 

Referring to Figure 1, the apparatus comprises a computer 
1= controlled stage or holder 100 for a Petri dish 101. The 

II Petri dish is illuminated by two light sources 102 and 103 

%5 and can be viewed by two cameras, one of which (104) has 

high magnification and the other (105) has lower 
magnification. Each camera is linked to an image analysing 
system 106. As shown this comprises a computer console 
107, a keyboard 108 and a visual display unit 109. The 
20 holder, light sources and camera equipment will normally be 

contained within a casing or shroud (not shown) . 

Figures 2 to 7 are referred to at appropriate places in the 
following detailed description of the reading system of the 
25 invention. 



2 . Imaqre Analysis 



2 . 1 Image Canture 

30 

The camera provides an analogue signal that represents the 
scene being viewed by the camera. This signal is digitised 
and stored in computer memory as an array of numbers, where 
each element of the array represents a picture element 
3 5 (pixel) , and its value represents the image brightness at 

that point in the original scene . Typically, black has a 
value of 0 and pure white a value of 255. Once the image 
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has been captured, it can be treated as computer data and 
manipulated by computer programs. The image can be 
displayed on a computer screen by using the pixel values to 
control the screen brightness and the result resembles the 
5 original analogue image . 

2-2 Thresholding to Segment an Image 

Thresholding is the process where all the pixels with 
.0 values between two limits are set to maximum white and all 

others are set to zero. We use thresholding to separate 
objects (white) from background (black) so that we can 
measure parameters such as size for each object. It is a 
very quick process to implement - the problem is to define 
.5 the limits so that only the features of interest are 

extracted. In this application, thresholding is used to 
extract the impregnated disks, the inhibition zones and the 
character codes. Correct thresholding is critical to the 
method presented here and requires an algorithm to define 
:0 the threshold automatically which can tolerate significant 

variations in image brightness. 

2-3 Automatic Threshold Level Determination 

:5 The brightness levels required to successfully threshold 

the various components of AST plate images are affected, 
for example, by the type of growth medium and bacteria, as 
well as the level of illumination. For the overall 
measurement to be automatic, a method of calculating the 

0 threshold level from the image is essential. The method 

implemented is faily robust, providing successful 
segmentation under a wide range of conditions and without 
operator intervention. 

5 There are many methods of automatic threshold 

determination, which can be used for the purposes of the 
invention. We have chosen a method used is based on that 



wo 99/02645 



PCT/GB98/01916 



12 

reported by Kittler et al, Computer Vision . Vol 30, 125-147 
(1985) . It assumes that all the pixels in an image can be 
assigned to one of two groups of objects on the basis of 
intensity. The object edges in the image should always 
5 straddle the boundary between the two regions. By using 

the edge image as a sampling mask, it is possible to 
estimate the best mean pixel value that will separate the 
two regions. Kittler et al showed that this could be done 
mathematically as follows : 

10 

Make the edge image from the input image (E) 
Multiply the input image by the edge image {M} 
Divide the sum of pixel values of (M) by that of (E) 
to give the threshold value 

15 

3 . The Metiliod: 

The physical layout of the equipment used consisted of two 
solid-state charge -coupled device (CCD) cameras [Hitachi 
20 KPMl] with fixed focal length lenses of 50mm and 12.5mm 

respectively, viewing the plate vertically from above - as 
seen in Figure 1. 

Each plate was positioned over a rotatable holder with a 
25 black light- trap underneath. This helped to maximise the 

difference between microbial growth and the inhibition 
zones . 

3 - 1 Finding- the Discs 

30 

A low magnification image of the AST plate is captured. 
The plate can be presented at any orientation, so the 
positions of the antibiotic discs are unknown and the first 
task is to find them. 



The discs are brighter than^most parts of the image and the 
threshold level required to select them is determined using 
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the automatic algorithm. The resulting image contains the 
discs, but may also contain some artifacts. Since the size 
of the discs is well known (6ram diameter) , all objects 
significantly larger or smaller than the discs can be 
5 rejected. 

The centres of gravity of the discs are measured and 
checked to ensure that they conform to an expected pattern 
(for example, octagonal for eight discs} within a 
10 predefined tolerance. If the disc positions fail this 

test, it is possible that a disc has been dislodged and is 
no longer at the centre of its inhibition zone, or that one 
of the detected objects is not a disc. 

15 3.2 Finding and Measuring the Inhibition Zones 

The inhibition zones are expected to be the darkest part of 
the image. Automatic thresholding is used again, but with 
a new threshold level to create an image consisting of the 

20 inhibition zones. The resulting image can be very complex 

since, in addition to the inhibition zones, there may be 
additional objects created by gaps in the spiral "coating or 
physical damage to the growth medium. Unlike the task of 
finding the discs, there is no easy way to reject the parts 

25 that are not inhibition zones. However, the following 

method of processing the image works well under a wide 
range of typical and adverse conditions. In essence, it 
monitors how well a circle can be fitted within the 
inhibition zone around each disc as a function of the 

3 0 circle radius, accepting the radius at which the fit 

criterion changes most rapidly from good to bad. 

Consider a circle of radius R, centred on one of the discs, 
where all the pixels in the ' zones ' image that lie directly 
3 5 under the circle are counted, giving the value C; the 

circle consists of pixels. If the circle lies fully 

within the zone, the value of C should be almost the same 
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as and the ratio C/C„„ should be close to 1 . If the 

circle lies outside the main zone area, C will be 
relatively small and C/C^ will be much less than 1. A non- 
zero value outside the zone can occur due to intersection 
5. with adjacent zones, gaps in the spiral coating, or some 

other artefact in the zones image . When the radius is such 
that the circle lies close to the edge of the zone, C/C^ 
will be at some intermediate value, and change rapidly for 
small changes in radius . 

10 

The algorithm consists of measuring the C/C^ ratio as a 

function of radius, making allowance for any parts of the 
|E circle which fall outside the limits of the sample plate, 

then finding the point at which the C/C^ ratio decreases 
X5 most rapidly. This corresponds well with visual placement 

of the best fit circle. 

Tests conducted on a wide range of samples, and over a wide 
range of illumination conditions, showed that this method 
20 produces consistently acceptable results. Failures were 

rare and inevitably due to poor segmentation of the zones . 
Figures 5a and 5b show the performance on a sample with 
high overlap. Another example is seen in Figures 6a/b. 

25 Table 1 shows the results of testing the reproducibility of 

the fitted radii, using a random selection of sample plate 
orientations. The standard deviation is the uncertainty in 
a single radius value, which is the usual case here. Hence 
the precision of the method is about +0.2mm. 

30 
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Table 1: Reproducibility Tests on Zone Size Measurement 



5 



10 



Disc 


Mean Radius 
(mm) 


Standard 
Deviation 


j 

Standard 
Error 


1 


16.5 


0 .14 


0 .04 1 


2 


8.0 


0.35 




3 


15 .7 


0.12 


0.04 ! 


4 


19-9 


0.16 


0 .05 i 


5 


20.8 


0 .22 


0 .07 1 


6 


11.2 


0 .05 


0.02 , 



3 • 3 Finding and Reading the Disc C.nci(=^^ 

Disks were prepared with the following code characteristics 
in order to simplify the code recognition task: 

mono- spaced 'sans s erif fnn^ - consistent spacing 

between characters permits checks that can resolve 
problems caused by broken and incomplete characters. 
The absence of serifs reduces possible linking of 
adjacent characters. 

underline bar: this is a small straight line 

underneath the code characters. It provides an object 
that defines the orientation of the printed code so 
that the image can be rotated to a consistent 
orientation, significantly simplifying the code 
recognition. 

An image of each disc is captured by the high magnification 
camera because the low magnification image does not provide 
sufficient resolution to detect the characters. Automatic 
thresholding is used to extract just the printed codes from 
the input image. All objects are measured and the 
underline character found as the object with the greatest 
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length/width ratio. Using the orientation of the 

underline, the rotation angle is calculated to present the 
characters in the normal, upright configuration. Rotation 
of character codes is discussed further below. Checks are 
made on the individual objects so that the parts of a 
fragmented character are correctly grouped together. a 
32x32 pixel region around each potential character is 
reduced to 16x16 pixels and passed to the neural net module 
for interpretation. 

The neural net module returns a three character list, 
giving the three closest characters to the supplied 
pattern. Data is also returned that estimate the 
confidence in the matching process. The returned character 
matches for each detected object are used to construct the 
total code for the disc under examination. Using the 
confidence data and the three possibilities for each 
character, a list of possible codes are generated and 
checked against a database of valid codes. This allows the 
automated process to recover from minor errors, perhaps 
caused by poor character definition, yet flag significant 
errors . 



3 ■ 4 Rotating Character Code Images 

The underline is used to calculate the orientation of the 
character codes, and thereby the rotation angle to achieve 
normal, upright orientation. The orientation of the 
underline gives two solutions which are 18 0° apart, the 
correct one is established by calculating where the 
character objects are, relative to the underline. It is 
possible for the underline to become fractured if the print 
quality is poor, or the threshold level badly set. When 
this happens, the largest fragment may still be 
sufficiently large to register as the underline. If it 
does not, one of the character objects will be chosen 
instead and the rotation angle will be erroneous . Checks 
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on the character object positions will reveal the error and 
further processing avoided. 

The underline character, and its components if fractured, 
must not be treated as though they are character objects. 
This is achieved by removing all objects co- linear with the 
underline character (within a set tolerance) . 

In order to interpret the codes as printed, it is essential 
to determine which row each character comes from; they are 
assigned to either the upper or lower row by comparing 
individual centres of gravity with the mean of all 
characters . 

As with the underline character, it is possible to get 
fragmented or broken character objects, and it is not wise 
to reject any objects on the basis of size. All potential 
character objects are compared with each other to determine 
if any overlap horizontally, or are narrower than the 
expected width (approx 32 pixels) . If fragmentation is 
detected, the fragments can usually be grouped 
unambiguously and treated as a single character object. 
This gives the neural net the best possible input and 
improves the chances of correct interpretation. 

Figures 3a, 3b and 3 c show examples of the grey level 
starting image, thresholded code with underline, and the 
final rotated code image . 

4 . Neural Networks for Qgtical Character Recocmition. 

An artificial neural net is used to recognise the 
characters on the susceptibility disc. Of crucial 
importance is the level of confidence in the character 
recognition. 
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^ • ^ Artificial Neur al Nehp; and Pattern RecoCTnif-ion 

Ttie task of recognising a character is essentially a 
pattern recognition task (Figures 2a-2c) . Each letter in 
the image of a susceptibility disk is isolated, centered 
and rotated to an approximately upright position. This 
image is stored as a sequence of O's and I's, and due to 
noise, any particular letter will have a large number of 
different sequences. The task of pattern recognition is to 
find an algorithm, which given a new pattern, or sequence 
of O's and I's, will determine which letter it most closely 
matches . 

An Artificial Neural Net is a computing algorithm that is 
based on the function and architecture of the brain, with 
many highly interconnected but small processing units. It 
is well suited to pattern recognition. 

Learned Vector Quantisation, or LVQ, is reported in T. 
Kohonen, Self -Or granis at ion and Associative Memory, 

Springer-Verlag, 1984. Each example pattern can be thought 
of as a point in a high dimension vector space. LVQ 
operates by creating one (or more) representatives for each 
character. During training, each representative is moved 
to a position so that each character is nearer to its 
representative than to the representative for a different 
character. During runtime operation, each new pattern that 
is presented to the LVQ is classified according to which 
representative it is nearest to. 

The neural net was "trained" by giving it example patterns 
and adapting the weights iteratively. 100 example patterns 
for each letter and number were generated from a print out 
on dry specimen card. These 3600 samples (36 letters + 
numbers x 100 examples) were split into two halves, with 50 
example patterns of each character. The neural net was 
trained on the first 1800, that is it "learnt" how to 
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recognise the letters and numbers in these examples. As a 
test, the neural net was then presented with the other 1800 
examples . 



4 . 2 Neural Net Performance on Real Plate Imacres 

The images of characters used for training and testing the 
Neural Net were captured from specimen card printed with 
example antimicrobial agent codes. In comparison, the 
print quality expected on typical discs in real use will be 
degraded by: 

(a) impregnation with antimicrobial agent and subsequent 
drying . 

(b) exposure to the culture medium during the 
susceptibility test. 



It was essential to assess the effect of this degradation 
on neural net performance by processing images of discs 
20 that had been used in 'real' susceptibility tests. The 

samples used for these tests were limited in number and in 
range of characters, consisting of 7 examples" of the 5 
codes FRIOO, RD2, CAZ3 0, MEZ3 0 and NIO, a total of 147 
characters . 

25 

The neural net recognised 146 correctly. It failed on one 
example of MEZ30 where the first, second and third best 
guesses for the character "0" (zero) were 8,0 and 6 
respectively. All were classified as 'possible', 

30 indicating a noisy image. Using these three guesses, the 

complete code could have been MEZ3 8, MEZ3 0 or MEZ3 6, but 
comparison with the valid code list eliminates the first 
and third, leaving MEZ30 as the correct answer. 

35 
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C149 . 02/0 
Claims 

1. A carrier device for use in. an antibiotic susceptibility 
test ("AST"), the device releasably carrying an antibiotic 
related to the test, and bearing machine readable information 
concerning the antibiotic, wherein the device also includes 
orientation means for enabling an image analyser to determine 
an optimal reading direction of the readable information. 

2. A device according to claim 1, in which the orientation 
means comprises means other than said machine readable 
information. 

3. A device according to claim 2, in which the orientation 
means is separate from said machine readable information. 

4. A device according to any of claims 1 tc 3, in which the 
machine readable information comprises a cede of one or more 
characters, whereby an image analyser comprising code reading 
means, can determine the oriencation of the code, using the 
orientation means, and can adjust: the oriencation of the code, 
or an image thereof, to bring the perceived orientation into 
alignment with that necessary for proper reading of the code. 

5/"~7? device according to any of the preceding claims, in which 
the device comprises an AST disk. 

6. A device according to any of the preceding claims, in which 
the orientation means comprises an arrangement of information 
presented on the device surface, in addition to the readable 
informal ion . 

7. A device according to any of the preceding claims in which 
said orientation means comprises linearly-arranged information. 
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8. A device according to claim 7, wherein said linearly- 
arranged information is parallel to the optimal reading 
direction of the readable information. 

9. A device according to claim 7 or claim 5, wherein said 
linearly- arranged information is a printed line or lines, 
printed below or above the readable inf orniaticn. 

10. A device according to claim 4, wherein said orientation 
means comprises an underline printed beneath the character 
code . 

11. " A device according to any of the preceding claims, in 
which sa'id machine readable information or character code 
identifies said substance and/or its concencracion. 

12. An image analysis system for interpreting AST plates, each 
of which holds a plurality of devices each in accordance with 
any of the preceding claims, the system comprising: 

support means for supporting an AST plate; 

camera means for imaging a plate supported by said 
support means ; and 

electronic information prrocessing means, preferably a 

'neural net, linked to said camera means, programmed or 

trained to 

locate an AST carrier device on said plate from among the 
plurality of AST carrier devices, 

identify orientation means on the locazed carrier device, 
and rotate the perceived image of the located device as 
recaiired so that the perceived image of a multi-character 
code printed on the device is brought into alignment with 
a proper reading direction for the coda, and 
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read the code . 

13. An image analysis system according tc claim 12, which 
additionally determines a visible characreriscic of the zone 
of inhibition, if any, surrounding the disk. 

14. An analysis system according to claim 13, wherein the 
electronic information processing means includes or is linked 
to an 'expert system' comprising a database of AST 
characteristics of known micro-organisms. 

15. An analysis system - according to claim 13 or claim 14, 
including display means for displaying the disk image. 

16. An analysis system according to any one of claims 13 to 
15, wherein the diameter of the zone of inhibition is 
determined. 

17. An analysis system according to any one of claims 13 to 
IS, wherein che system is programmed or crained to identify 
orientation means which comprises an underline printed beneath 
the multi-character code. 

18. An image analyser for use in determining the result of 
susceptibility testing of micro-organisms on a culture medium, 
comprising: 

a) camera means for viewing the culture medium; 

b) elecrrcnic information processing means, linked to said 
camera means, programmed or trained to interpret: any region of 
visibly altered micro-organism growth in che vicinity of a 
susceptibility testing device, such as a disk, present on the 
culture medium, wherein said processing means is also 
programmed or trained to read a character code on the device 
indicative of the susceptibility reagent in the device and to 
interpret orientation means incorporated in or on the device 
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by which the optimal reading.- direction of the character code 
can be recognised, and to adjust as necessary the actual 
reading direction to bring this into line with the actual 
orientation of the character cede on the device. 
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DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated 
below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, 
first and joint inventor (if plural names are listed below) of the subject matter which is claimed and 
for which a patent is sought on the invention entitled Image Analysis Systems and 

Devices for use therewith ^ o^^^-*:^^*-- ^ i,- -u 
, the specification of which: 

is attached hereto. 



Application Serial No. PCT/GB98/01916 

and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above identified specification, 
including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination of this 
application in accordance with Title 37, Code of Federal Regulations, Section 1.56(a). 



I hereby claim foreign priority benefits under Title 35, United States Code, Section 119 of any 
foreign application(s) for patent or inventor's certificate listed below and have also identified below 



any foreign application for patent or inventor's certificate having a filing date before that of the 
application on which priority is claimed: 

PRIOR FOREIGN APPLICATION(S) 

Priority Claimed 

Country Number Date Filed Yes No 

UK 9714347.3 09.07.1997 x 



I hereby claim the benefit under Title 35, United States Code Section 120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this application 
is not disclosed in the prior United States application in the manner provided by the first paragraph 
of Title 35, United States Code, Section 1 12, 1 acknowledge the duty to disclose material information 
as defined in Title 37, Code of Federal Regulations, Section 1.56(a) which occurred between the 
filing date of the prior application and the national or PCT international filing date of this application. 
A pplication Serial No. Filing Date Status 



And I hereby appoint Wm. Marshall Lee, Registration No. . 16, 853, John M. Mann, Registration No. 
_17^/775, Thomas E. Smith, Registration N o. 18,243 , Dennis M. McWilliams, Registration No. 
25JS5^ James R. Sweeney, Registration No . 18,72 1, William M. Lee, Jr., Registration No^6,935, 
Glenn W. Ohlson, Registration No . 28,455, David C. Brezina, Registration No. 34.128, Jeffrey R. 
Gray, Registration No . 33,391_ . Timothy J. Engling, Registration No. 39,970, Gregory B. Beggs, 
Registration No. 19,286 , Gerald S. Geren, Registration No. 24.528 and Peter J. Shakula, 
Registration No. 40,808 a s my attorneys to prosecute this application and to transact all business in 



the Patent and Trademark Office connected herewith. It is requested that all communications be 
directed to Lee, Mann, Smith , McWilliM QS, Sweeney & Ohlson. P.O. Box 2786, Chicaga JQlinojs 
6069 0-2786, telephone number (312) 368-1300. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements 
made on information and belief are believed to be true; and further that these statements were made 
with the knowledge that willful false statements and the like so made are punishable by fme or 
imprisonment, or both, under Section 1001 of Tide 18 of the United States Code and that such willful 
false statements may jeopardize the validity of the application or any patent issued thereon. 
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